#LLM collaboration

'Cache-to-Cache (C2C) lets LLMs exchange semantic information via KV-Cache fusion, boosting accuracy by about 3–10% over text-based pipelines and roughly halving latency.'

MediaTek Research introduces Group Think, a novel token-level multi-agent paradigm that enables concurrent reasoning in large language models, significantly speeding up inference and enhancing collaborative problem-solving.